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We classify locally defined Levi non-degenerate non-spherical 
real-analytic hypersurfaces in complex space for which the 
dimension of the group of local CR- automorphisms has the 



> 

second largest positive value. 
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1 Introduction 

Let M be a real-analytic hypersurface in C n+1 passing through the 
origin. Assume that the Levi form of M at is non-degenerate and 
has signature (n — m, m) with n > 2m. Then in some local holo- 
morphic coordinates z — (z\, . . . , z n ), w = u + iv in a neighborhood 
of the origin, M can be written in the Chern-Moser normal form 
(see [CM]), that is, given by an equation 

Q k,l>2 
> 

^ . where (z, z) = h a f3Z a Z/3 is a non-degenerate Hermitian form 

a,P=l 

with signature (n — m, m), and F k j(z,z, u) are polynomials of degree 
k in z and I in ~z whose coefficients are analytic functions of u such 
that the following conditions hold 





= 0, 


tr 2 F 25 


= 0, 


tr 3 F 3 3 


= 0. 



(1.1) 



Here the operator tr is defined as 



n 



tr := h a p 

a,P=l 



d 2 



dz a &zp 
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where is the matrix inverse to H := (h a p). Everywhere below 
we assume that M is given in the normal form. 

Let Auto(M) denote the group of all local CR-automorphisms 
of M defined near and preserving 0. To avoid confusion with 
the term "isotropy group of M at 0" usually reserved for global 
CR-automorphisms of M preserving the origin, this group is often 
called the stability group of M at 0. Every element p of Auto(M) 
extends to a biholomorphic mapping defined in a neighborhood of 
the origin in C n+1 and therefore can be written as 

z i-> U(z,w), 
w i-> g v (z,w), 

where f v and g v are holomorphic. We equip Aut (M) with the 
topology of uniform convergence of the partial derivatives of all 
orders of the component functions on a neighborhood of 0. The 
group Auto(M) with this topology is a topological group. 

It follows from [CM] that every element ip = (f v , g v ) of Auto(M) 
is uniquely determined by a set of parameters (U^, a v , X v , a^,, r^), 
where a v = ±1, U v is an n x n-matrix such that (U^z^U^z) = 
(T ip (z, z) for all z E C n , a v G C n , A v > 0, r v E R (note that can 
be equal to —1 only for n = 2m). These parameters are determined 
by the following relations 

§-f(0) = V^, |^(0) = A^a„ 



^(0) = ^ ? Re^(0) = 2a^ V 

For results on the dependence of local CR-mappings on their jets 
in more general settings see [BER1], [BER2] , [Eb], [Z]. 

We assume that M is non-spherical at the origin, i.e., that M 
in a neighborhood of the origin is not CR-equivalent to an open 
subset of the hyperquadric given by the equation v = (z,z). In 
this case for every element ip = (f v , g v ) of Auto(M) the parameters 
Otp^r^ are uniquely determined by the matrix U v , and the 
mapping 

$ : Auto(M) -»• GL n (C), $ : <p i-> U v 

is a topological group isomorphism between Auto(M) and Go := 
$(Auto(M)) with Go being a real algebraic subgroup of GL n (C); 
in addition the mapping 

A : G (M) -> R + , A : U v ^ \ (1.2) 
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is a Lie group homomorphism with the property A(C/ V ,) = 1 if all 
eigenvalues of are unimodular, where M + is the group of positive 
real numbers with respect to multiplication (see [CM], [B], [LI], 
[BV], [VK]). Since G (M) is a closed subgroup of GL n (C), we can 
pull back its Lie group structure to Auto(M) by means of $ (note 
that the pulled back topology is identical to that of Auto(M)). Let 
do(M) denote the dimension of Auto(M). We are interested in 
characterizing hypersurfaces for which d (M) is large. 

If n > 2m, Gq(M) is a closed subgroup of the pseudounitary 
group U(n — m, m) of all matrices U such that 

l^HU = H, 

(recall that H is the matrix of the Hermitian form (z,z)). The 
group U(n, 0) is the unitary group U(n). If n — 2m, G is a closed 
subgroup of the group U'(m,m) of all matrices U such that 

tfHU = ±H, 

that has two connected components. In particular, we always have 
d (M) < n 2 . If d (M) = n 2 and n > 2m, then G (M) = U(n - 
m,m). If do(M) = n 2 and n = 2m, then we have either Gq(M) = 
U(m,m), or G (M) = U f (m,m). 

We will say that the group Auto(M) is linearizable, if in some 
coordinates every <p e Aut (M) can be written in the form 

Z " XU J' (1-3) 

Clearly, in the above formula U — U^, X — A^, a — a v . The group 
Auto(M) is known to be linearizable, for example, for m = (see 
[KL]) and for m = 1 (see [Ezhl], [Ezh2]). If all elements of Aut (M) 
in some coordinates have the form (1.3), we say that Auto(M) is 
linear in these coordinates. It is shown in Lemma 3 of [Ezh3] that 
if Auto(M) is linear in some coordinates, it is linear in some normal 
coordinates as well. 

We will first discuss the case when d (M) takes the largest pos- 
sible value, that is, when do(M) = n 2 . Observe that in this case 
Auto(M) is linearizable for any m. Indeed, if do(M) = n 2 , the 
group Gq{M) contains U(n — m,m). Hence G (M) contains the 
subgroup Q := {e lt ■ E n , t £ R}, where E n is the n x n identity 
matrix. Let Q = $ _1 (<5) C Aut (M). The subgroup Q is com- 
pact, and the argument in [KL] (see also [VK]) yields that in some 
normal coordinates every element of Q can be written in the form 
(1.3). For every ip G Q we clearly have <y Lp = \. Further, since Q is 
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compact, there are no non-trivial homomorphisms from Q into R+, 
and therefore A^, = 1 for every ip G Q. Hence, in these coordinates 
the function 

F(z,z,u) := F ki( z >z> u ) 

k,l>2 

is invariant under all linear transformations from Q and thus F k j = 
0, if A: I. We will now show that Auto(M) is linearizable. 
Since linearizability arguments of this kind will occur several times 
throughout the paper, we give some details on the linearizability of 
Auto(M) for general hypersurfaces. 

Suppose that M is given in the Chern-Moser normal form near 
the origin. The main step in showing that Auto(M) is linearizable 
is to prove that in some normal coordinates for every <p G Auto(M), 
we have a v = 0. Indeed, if = 0, it follows from [CM] that tp in the 
given coordinates is a fractional linear transformation that becomes 
linear if r v = 0. It is shown in the proof of Proposition 3 of [L2] that 
a v = implies that r v = 0, provided \ v = 1. Furthermore, if for 
every ip G Auto(M) we have a v = and there exists y?o G Auto(M) 
with A^y 7^ 1, the group Auto(M) becomes linear after applying a 
transformation of the form 



+ qw 

(1.4) 

w 



w 



1 + qw ' 



for some gel. 

To prove that = for a fixed ip = (f^g^) in the given 
coordinates, we introduce weights as follows. Let each of z±, . . . , z n , 
Zi, . . . , ~z^ be of weight 1 and u be of weight 2. Then we can write 
a weight decomposition for the function F as follows 

oo 

F(z,z,u) = J2 F i, 

3=1 

where Fj is the component of F of weight j, and F 7 ^ 0. Next, 
since ip is a local automorphism of M, we have 

Im# v = {f v ,f v ) +F(f v ,f v ,Reg v ,) , (1.5) 

where we set v = (z, z) + F(z, z, u). Extracting all terms of weight 
7+1 from identity (1.5), we obtain the following identity (see [B], 
[LI], [L2]) 

Re {ig 1+1 + 2(\- 1 U- 1 f 7 ,z)) \ v={z , z) +T(F 7 ,a v ) = 

F 7+1 (z,z,u) - -^■F 7+ i(A v ,C/ v z,A v ,C/ v ,z,Aj«). ^' 6 ^ 

v 
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Here (Sjli fj, Sjli 9j) is the weight decomposition for the map 

(/,<?) := (U ~ f$,9<p ~ 9$), where y? Q = (f$,g$) is the following 
local automorphism of the hyperquadric given by the equation v = 

(z,z) 



\ v U v (z + a v w) 



w 



1 — 2i(z, a) — (r^ + i(a, a))u>' 

Q-yA^w 

1 — 2i(z, a) — (r v + i(a, a))w' 



and 



n dF 

T(F 7 , a^) := 2Re (-2i(z, a {p )F 1 + (« + i(z, z)) a iJT L+ 

j=l C)Z j 

n dF dF \ 

2i(z, a) Y, z i-Q^ + j ( z > a v)( u + z ))-fa) ' 

j=l 3 

where denote the components of the vector a^. 

If F 7+ i = 0, the right-hand side of (1.6) vanishes, and the proof 
of Proposition 1 in [LI] shows that the resulting homogeneous iden- 
tity can only hold if a v = 0. Clearly, if F k j = for k ^ I, then the 
weight decomposition for F contains only terms of even weights, 
and, in particular, we have F 1+ \ = 0. Thus, we have shown that 
Aut (M) is linearizable if d {M) = n 2 . 

Observe further that if d (M) = n 2 , the mapping A defined 
in (1.2) is constant, that is, A v = 1 for all (p G Auto(M). In- 
deed, consider the restriction of A to U(n — m,m). Every element 
U G U{n — m, m) can be represented as U = e 1 ^ ■ V with ijj G M 
and V G SU(n — m,m). Note that there are no non-trivial homo- 
morphisms from the unit circle into M + since M + has no non-trivial 
compact subgroups. Also, there are no non-trivial homomorphisms 
from SU(n — m, m) into R+ since the kernel of any such homo- 
morphism is a proper normal subgroup of SU (n — m, m) of positive 
dimension, and SU (n—m, m) is a simple group. Thus, A is constant 
on U(n — m,m) and hence on all of G (M). It then follows that, in 
coordinates in which Aut (M) is linear, the function F is invariant 
under all linear transformations of the z- variables from U(n—m, m) 
and therefore depends only on (z, z) and u. Conditions (1.1) imply 
that F 2 2 = 0, F33 = 0. Thus, F has the form 

00 

F(z,z,u) = Y,C k (u)(z,z) k , (1.7) 

where Ck(u) are real- valued analytic functions of u, and for some k 
we have Cj~(u) ^ 0. Note, in particular, that if d (M) = n 2 , then 
is an umbilic point of M. 
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Conversely, if M is given in the normal form by an equation 

v = (z,z) + F(z,z,u), 

with F ^ of the form (1.7), then Auto(M) contains all linear 
transformations (1.3) with U G U(n — m, m), A = 1 and o — 1, 
and therefore d (M) = n 2 . For n > 2m and for n = 2m with 
G (M) = U(m,m), Aut (M) clearly coincides with the group of 
all transformations of the form 

Z " ^' (1.8) 
w i— > w. 

where U G U(n — m,m). If n = 2m and G (M) = U'(m,m), then 
Aut (M) consists of all mappings 

z I— > J7z, 
w i— > trw, 

where C/ G U'(m, m), (Uz, Uz) = cr(z, z), a — ±1. 

We will now concentrate on the case < d (M) < n 2 (hence 
assuming that n > 2). For the strongly pseudoconvex case we 
obtain the following 

THEOREM 1.1 Let M be a strongly pseudoconvex real-analytic 
non-spherical hypersurface in C n+1 with n > 2 (here m = 0) given 
in normal coordinates in which Auto(M) is linear. Then the fol- 
lowing holds 

(i) do(M) > n 2 - 2n + 3 implies d (M) = n 2 ; 

(ii) if do(M) = n 2 — 2n + 2, after a linear change of the z-coordinates 
the equation of M takes the form 

v=Y J \z a \ 2 + F{z,z,u) } (1.9) 

a=l 

n 

where F is a function of \zi\ 2 , (z, z) := \z a \ 2 and u: 

a=l 

F(z,z,u)= ]T C pq {u)\z^{z,z)\ (1.10) 

P+<?>4 

where C pq (u) are real-valued analytic functions of u, andC pq (u) ^ 
for some p, q with p > 0; 
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(in) if a hypersurface M is given in the form described in (ii) (with- 
out assuming the linearity ofAuto(M) a priori), the group Auto(M) 
coincides with the group of all mappings of the form (1.8), where 
U G U (1) x U(n — 1) (with U(l) x U(n — 1) realized as a group of 
block-diagonal matrices in the standard way). 

Corollary 1.2 If M is a strongly pseudoconvex real-analytic hy- 
persurface in C n+1 , and the dimension of Aut (M) is greater than 
or equal to n 2 — 2n + 2, then the origin is an umbilic point of M. 

For the case m > 1 we prove the following 

THEOREM 1.3 Let M be a Levi non-degenerate real-analytic 
non-spherical hypersurface in C n+1 with m > 1. Then the follow- 
ing holds 

(i) do(M) > n 2 - 2n + 4 implies d (M) = n 2 ; 

(ii) ifdo(M) = n 2 — 2n + 3, the group Auto{M) is linearizable and in 
some normal coordinates in which Auto(M) is linear, the equation 
of M takes the form 

v = 2Rez{z n + 2Rez 2 z n - 1 + . . . + 2Re z m z n ^ m+ i + 

if \z a \ 2 + F(z,z,u), (L11) 

a=m+l 

where F is a function of \z n \ 2 , (z,z) := 2Rez{z n + 2Rez 2 z n ^i + 

n—m 

... + 2Rez m z n _ m+ i+ \z a \ 2 andu: 

a=m+l 

F(z,z,u) = Y J C rpq u r \z n \ 2p {z,z)\ (1.12) 

where at least one of C rpq G K is non-zero, the summation is taken 
over p > 1, q > 0, r > such that (r + q — l)/p— s with s > —1/2 
being a fixed rational number, and 

F(z,z,u) = ]T F kJ (z,z,u), 

k,l>2 

where F 2 ^ = and identities (1.1) hold for F^ and F 3 ^; 
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(Hi) if a hypersurface M is given in the form described in (ii) (with- 
out assuming the linearity of Auto(M) a priori), the group Auto(M) 
coincides with the group of all mappings of the form 

z ^ Ifi^'+^Uz, 



w 



H 2/(S+1 V ' (1,13) 



with U G S, where S is the group introduced in Lemma 3.1 below, 
and u, is a parameter in this group (see formula (3.2)). 

Corollary 1.4 Let M be a Levi non- degenerate real-analytic hy- 
persurface in C n+l , with n > 2 and m > 1, and assume that the 
dimension of Auto(M) is greater than or equal to n 2 — 2n + 3. If the 
origin is a non-umbilic point of M, then in some normal coordinates 
the equation of M takes the form 

v = 2Rez{z n + 2Rez 2 z n ~i + • • • + 

OR P7 ? , i V™ \y I 2 + \y I 4 ( 1-14 ) 

a=m+l 

We remark that hypersurfaces (1.14) occur in [P] in connection 
with studying unbounded homogeneous domains in complex space. 

The proofs of Theorems 1.1 and 1.3 are given in Sections 2 and 
3 respectively. Before proceeding we wish to acknowledge that this 
work was initiated while the first author was visiting the Mathe- 
matical Sciences Institute of the Australian National University. 



2 The Strongly Pseudoconvex Case 

First of all, we note that in this case the mapping A defined in (1.2) 
is constant, that is, A v = 1 for all tp G Aut (M). This follows from 
the fact that all eigenvalues of U v are unimodular, or, alternatively, 
from the compactness of Gq(M) and the observation that M + does 
not have non-trivial compact subgroups. Next, by a linear change of 
the ^-coordinates the matrix H can be transformed into the identity 
matrix E n , and for the remainder of this section we assume that 
H = E n . Hence we assume that the equation of M is written 
in the form (1.9), where the function F satisfies the normal form 
conditions. 

It is shown in Lemma 2.1 of [IK] that any closed connected 
subgroup of the unitary group U (n) of dimension n 2 — 2n + 3 or 
larger is either SU(n) or U(n) itself. Hence, if do(M) > n 2 — 2n + 
3, we have Gq(M) D SU(n), and therefore F(z,z,u) is invariant 
under all linear transformations of the z- variables from SU (n). This 
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implies that F(z,z, u) is a function of (z, z) and u, which gives that 
F(z,z,u) is invariant under the action of the full unitary group 
U(n) and thus d (M) = n 2 , as stated in (i). 

The proof of part (ii) of the theorem is also based on Lemma 
2.1 of [IK]. For the case do(M) = n 2 — 2n + 2 the lemma gives that 
the connected identity component Gq of Go is either conjugate in 
U(n) to the subgroup U(l) x U(n — 1) realized as block-diagonal 
matrices, or, for n — 4, contains a subgroup conjugate in U(n) to 
Sp 2> o • If the latter is the case, then, since Sp 2 fl ac ts transitively on 
the sphere of dimension 7 in C 4 , F(z, z, u) is a function of (z, z) and 
u, which implies that F(z,z,u) is invariant under the action of the 
full unitary group U(A) and thus d (M) = 16, which is impossible. 
Hence Gq is conjugate to U(l) x U(n — 1), and therefore, after 
a unitary change of the ^-coordinates, the equation of M can be 
written in the form (1.9) where the function F depends on \z\\ 2 , 

n 

(z,z)' := \z a \ 2 and u. Clearly, (z,z)' = (z,z) — \zi\ 2 , and F 

can be written as a function of \zi\ 2 , (z,z) and u as in (1.10). 
Next, conditions (1.1) imply that F^ = 0, F 3 g = 0, and thus the 
summation in (1.10) is taken over p, q such that p+q > 4. Further, if 
C pq = for all p > 0, F has the form (1.7) and therefore Go = U(n) 
which is impossible. Thus for some p, q with p > we have C pq ^ 0, 
and (ii) is established. 

If M is given in the normal form and is written as in (1.9), 
(1.10), Auto(M) clearly contains all maps of the form (1.8) with U G 
U(l)xU(n-l). Rencedo(M) >n 2 -2n+2. lid (M) >n 2 -2n+2, 
then by part (i) of the theorem, do(M) = n 2 and hence Gq(M) = 
U(n). Then F has the form (1.7) which is impossible because for 
some p, q with p > the function C pq does not vanish identically. 
Thus d (M) = n 2 - 2n + 2, and hence G%{M) = U(l) x U(n - 1). 
It is not hard to show that Gq(M) is connected (note, for example, 
that by an argument given in the introduction, Auto(M) is linear in 
these coordinates), and therefore Auto(M) coincides with the group 
of all mappings of the form (1.8), where U G U(l) x U(n — 1). 

Thus, (iii) is established, and the theorem is proved. □ 

3 The Case of m > 1 

We start with the following algebraic lemma. 

Lemma 3.1 Let G C U(n — m,m) be a connected real algebraic 
subgroup of GL n (C), n > 2m, m > 1, with Hermitian form pre- 
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served by U(n — m, m) written as 



( 







1 \ 



E, 



rt— 2m 







v 



(3.1) 



where E n _ 2m is the {n — 2m) x (n — 2m) identity matrix, and the 
number of 1 's on each side of E n _ 2m is m. Then the following holds 

(a) if dim G > n 2 — 2n + 4, we have either G = SU {n — m,m), or 
G = U(n — m, m); 

(b) if dimG = n 2 — 2n + 3, the group G either is conjugate in 
U(n — m, m) to the group S that consists of all matrices of the 
form 



( fx —(jlx H'A c \ 



x 



V o 







(3.2) 



where fx, c G C, /i ^ 0, x E C n ~ 2 , A e U(n - m - 1, m - 1) (i.e., 
A is an {n — 2) x {n — 2)-matrix with complex elements such that 
A T H'A = H' with H' obtained from matrix (3.1) by removing the 
hrst and the last columns and rows), and the following holds 



2Re- + x T H'x = 0, 
fx 



or, if n = 4 and m = 2, coincides with e m {Sp 4 (B, C) n SU(2, 2) 
or, if n = 2 and m — 1, coincides with SU(1, 1). Here the sub- 
group Sp4(B,C) C GL 4 (C) consists of matrices preserving a non- 
degenerate skew-symmetric bilinear form B equivalent to the form 
given by the matrix 



B :- 



E 2 
-E 2 



(3.3) 



where E 2 is the 2x2 identity matrix, 
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Proof: Let V C U(n — m, m) be a real algebraic subgroup of 
GL n (C) such that dimV > n 2 - 2n + 3. Consider Vi := V n 
£[/(n - m,m). Clearly, dimVi > n 2 - 2n + 2. Let Vf C SX n (C) 
be the complexification of V\. We have dimcV 7 1 c > n 2 — 2n + 2. 
Consider the maximal complex closed subgroup W(V) C SL n (C) 
that contains Vf. Clearly, dimcW(V) > n 2 — 2n + 2. All closed 
maximal subgroups of SL n (C) had been classified (see [D]), and the 
lower bound on the dimension of W(V) gives that either VF(V") = 
SL n (C), or W(V) is conjugate to one of the parabolic subgroups 



(note that P 1 = P 2 for n — 2), or, for n — 4, VF(V') is conjugate to 



Suppose that for some g E SL n (C) and j E {1,2} we have 
g~ 1 W(V)g = P j . It is not hard to show that, due to the lower 
bound on the dimension of W(V), g can be chosen to belong to 
SU(n — m,m). Then g" 1 V±g C P-' fl SU(n — m,m). It is easy to 
compute the intersections P J fl SU (n — m, m) for j = 1,2 and see 
that they are equal and coincide with the group Si of matrices of 
the form (3.2) with determinant 1. Clearly, dimS'i = n 2 — 2n + 2 < 
dimV^ and therefore V\ is conjugate to S\ in SU(n — m,m). 

Suppose now that n = 4 and for some g E SX 4 (C) we have 
g-iwlvjg = Sp 4 (C). In particular, g~ x V x g C Sp 4 (C) Hg^SU^ - 
m, m)g (here we have either m — 1, or m — 2). It can be shown that 
dim5p 4 (C) n g^SUiS, l)g < 6 for all g E SL 4 (C). At the same 
time we have dim V\ > 10. Hence VV(V') in fact cannot be conjugate 
to Sp^C), if m — 1. Therefore, m — 2, and V\ C gSp^tyg^ 1 fl 
SU(2, 2) = Sp 4 (B, C) fl SU(2, 2), where B is some non-degenerate 
skew-symmetric bilinear form. It is straightforward to show that 
Sp 4 (B, C) n SU(2, 2) is connected and dim Sp 4 {B, C) n SU(2, 2) < 
10. Therefore V x = Sp 4 (B, C) n SU(2, 2). 

Suppose now that dimG > n 2 — 2n+4. Then dirnGx > n 2 —2n+ 
3, and the above considerations give that W(G) = SL n (C). Hence 
G\ = SU (n — m, m) which implies that either G = SU (n — m,m), 
or G = U{n — m, m), thus proving (a). 

Let dimG = n 2 — 2n + 3. In this case we have either dimGi = 
n 2 — 2n + 2, or G = £7/(1, 1), if n — 2, m — 1. In the first case 
we obtain that G 1 either is conjugate to £i in SU(n — m,m), or, 





£p 4 (C). 
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for n = 4 and to = 2 coincides with Sp±(B, C) n S'f/ (2, 2) for some 
non-degenerate skew- symmetric bilinear form B equivalent to the 
form B defined in (3.3). This gives that G in the first case either 
is conjugate to S in U(n — to, to), or for n = 4 and to = 2 coincides 



We will now prove Theorem 1.3. Suppose first that d (M) > 
n 2 — 2n + 4 and assume that H is written in the diagonal form with 
l's in the first n — to positions and — l's in the last to positions on 
the diagonal. Lemma 3.1 gives that either Gq(M) = SU(n — m,m) 
(in which case n > 3), or G (M) — U(n — m,m), or, for n = 2m, 
G (M) = U'(m,m). If G (M) D U(n - to,to), then do(M) = 
n 2 , and (i) is established. Assume that C (M) D SU(n — to, to). 
Suppose that to > 2. Then Go contains the product i? := SU(n — 
to) x SU(m) realized as block-diagonal matrices. Arguing as in 
the introduction, we obtain that in some normal coordinates all 
elements of the compact group R := $ _1 (-R) can be written in 
the form (1.8) and thus F is a function of (z,z) + := Y^ZT \ z j\ 2 -> 
(z, z)- := J2j= n -m+i \ z i\ 2 -> an d u. Hence all elements of odd weight 
in the weight decomposition for F are zero. This shows that F 1+ \ = 
0, and identity (1.6) again implies that Auto(M) becomes linear 
after a change of coordinates of the form (1.4). If to = 1, Aut (M) 
is linearizable by [Ezhl], [Ezh2]. 

Therefore, there exist normal coordinates where the correspond- 
ing function F is invariant under all linear transformations of the 
z- variables from SU(n — m,m). This implies that F is in fact 
invariant under all linear transformations of the ^-variables from 
U {n — to, to) . Hence d (M) = n 2 , and (i) is established. 

Suppose now that d (M) = n 2 — 2n+3. By a linear change of the 
^-coordinates the matrix H can be transformed into matrix (3.1), 
and from now on we assume that H is given in this form. Hence 
the equation of M is written as in (1.11), where the function F 
satisfies the normal form conditions. Arguing as in the preceding 
paragraph, we see that for n = 2, to = 1, the group Gq cannot 
coincide with SU(1, 1). Assume first that after a linear change of 
the ^-coordinates preserving the form H the group Gq(M) coincides 
with S. Then G (M) contains the compact subgroup Q = {e lt ■ 
E n , t G R}, where E n is the n x n identity matrix. The argument 
based on identity (1.6) that we gave in the introduction, again 
yields that Auto(M) is linearizable. Passing to coordinates in which 
Auto(M) is linear, we obtain that for every U G S the equation of 




The lemma is proved. 



□ 
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M is invariant under the linear transformation 

z i— > XuUz, 
w I— > A^w, 

where = A(C/). The group S contains U(n — m — l,m — 1) 
realized as the subgroup of all matrices of the form (3.2) with // = 1, 
c = 0, x = 0. Since A is constant on U(n — m — 1, m — 1), we 
have A [/ = 1 for all f/ G U(n — m — l,m — 1). Therefore, the 
function F(z,z,u) depends on Zi, z n , z±, z n , {z,z) f := 2Rez 2 z n -i + 

n—m 

. . . + 2Rez m z n _ m+ i + ^ \z a \ 2 and u. Clearly, (z, z)' = (z, z) - 

a=m+l 

2Re z{z^, and F can be written as follows 

F(z,z,u) = D rq (z 1 ,z n ,z 1 ,z n )u r (z,z) q , 

r,q>0 

where D rq are real- analytic. 

We will now determine the form of the functions D rq . The group 
S contains the subgroup / of all matrices as in (3.2) with = 1, 
x = and A = E n _ 2 , where E n _ 2 is the (n — 2) x (n — 2) identity 
matrix. Since every eigenvalue of any U e / is unimodular, we 
have Xjj = 1 for all U G /, and therefore -D riJ is invariant under 
all linear transformations from /. It is straightforward to show (see 
also [Ezh2]) that any polynomial of z±, z n , z±, z^ invariant under all 
linear transformations from J is a function of Rezi~z n and \z n \ 2 , and 
hence every D rq has this property. Let further J be the subgroup 
of S given by the conditions /i = 1, A = E n _ 2 . For every U G J 
we also have \u — 1, and hence D rq is invariant under all linear 
transformations from J. It is then easy to see that D rq has to be a 
function of \z n \ 2 alone. Thus, the function F has the form (1.12), 
and it remains to show that the summation in (1.12) is taken over 
P>1,?>0, r>0 such that (r + q — l)/p — s, where s > —1/2 is 
a fixed rational number. 

Let K be the 1-dimensional subgroup of S given by the condi- 
tions pi > 0, c = 0, x = 0, A = E n _ 2 . It is straightforward to show 
that every homomorphism ^ : K — > IR + has the form U i— > 
where a G R. Considering \I/ = A|# we obtain that there exists 
a G R such that for every U G K we have A;y = We will now 
prove that q^O. Indeed, otherwise F would be invariant under all 
linear transformations from K and therefore would be a function 
of (z, z) and u, which implies that Gq{M) D U(n — m,m). This 
contradiction shows that q^0 and hence Xjj ^ 1 for every U E K 
with /i 7^ 1. 



(3.4) 
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Plugging a mapping of the form (3.4) with U 6 if, /i / 1, into 
equation (1.11), where F ^ has the form (1.12) we obtain that, 
if C rpq 7^ 0, then 

A r+P+ 9 -l = ^ ( 35 ) 

The equation of M is written in the normal form, hence p + q > 2 
and r + p + q— 1 > 1. Since \u ^ 1, we obtain that p > 1. Further, 
(3.5) implies 

\(r+p+q-l)/p _ 

and, since the right-hand side in the above identity does not depend 
on r,p,q, for all non-zero coefficients C rpq the ratio (r + q — l)/p 
must have the same value; we denote it by s. Clearly, s is a rational 
number and s > —1/2. We also remark that a = p/(r+p + q — l) = 

1/(8 + 1). 

Assume now that n = 4, m = 2 and Gq(M) coincides with 
e tR (^Sp4(B , C)f]SU (2, 2)) for some non-degenerate skew-symmetric 
non-degenerate bilinear form B equivalent to the form Bo defined 
in (3.3). Then Gq(M) contains the compact subgroup Q = {e lt • 
E A) t E M.}, where E 4 is the 4x4 identity matrix. Arguing as above, 
we obtain that Aut (M) is linearizable. Further, it is straightfor- 
ward to prove that Sp^B, C) n SU (2, 2) is a real form of Sp^(B, C) 
and therefore is simple. Hence there does not exist a non-trivial 
homomorphism from Sp4(B,C) n £7/(2, 2) into R + . Further, since 
R + does not have non-trivial compact subgroups, any homomor- 
phism from the unit circle into M + is constant. Hence A is constant 
on Gq(M). This implies that F is invariant under all linear trans- 
formations from Sp4(B,C) n £C/(2,2). It can be shown that this 
group acts transitively on any pseudosphere in C 4 given by the 
equation (z, z) = r, which yields that F is a function of (z, z) and 
u and hence d (M) = n 2 . This contradiction proves that in fact 
G C (M) ^ e*(S , p 4 (5,C) n £C/(2,2)) for n = 4, m = 2. Thus, (ii) 
is established. 

Suppose that M is given in the normal form, written as in (1.11), 
(1.12), and the summation in (1.12) is taken over p > 1, q > 0, 
r > such that (r + q — l)/p = s, where s > —1/2 is a fixed 
rational number. Set a = l/(s + 1) and for every U G S define 
A(7 = It is then straightforward to verify that every mapping 
of the form (3.4) with U G S is an automorphism of M. Therefore, 
G (M) contains S and hence d (M) > n 2 - 2n + 3. If d (M) > 
n 2 — 2n + 3, then by part (i) of the theorem, d (M) = n 2 and hence 
Gq(M) d U(n — m,m). Then F is a function of (z, z) and u, which 
is impossible since for every non-zero C rpq we have p > 1. Hence 
d (M) = n 2 — 2n + 3 and hence Gq(M) = S. Finally, observe that 
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by an argument given in the introduction, Auto(M) is linear in 
these coordinates. It is now straightforward to show that Auto(M) 
coincides with the group of all mappings of the form (1.13). 

Thus, (iii) is established, and the theorem is proved. □ 
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